Markov Decision Processes from Colored Petri Nets
نویسندگان
چکیده
Models that are suitable for planning are not always easy to specify. In this paper we investigate the conversion of Petri nets into factored Markov decision processes: the former are relatively easy to build while the latter are adequate for policy generation. To represent probabilities that are needed when planning under uncertainty, we introduce factored Petri nets; we then describe the conversion of factored Petri nets in Markov decision processes.
منابع مشابه
From Colored Petri Nets to Markov Decision Processes
The present work is motivated by the need to consider stochastic behavior when planning production mix in a manufacturing system. Because methods that are suitable for planning are not always appropriate for modeling the systems and viceversa, two methods are combined here: systems are modeled using colored Petri nets and then converted into Markov decision processes. A special type of Petri ...
متن کاملColored Decision Process Petri Nets: Modeling, Analysis and Stability
In this paper we introduce a new modeling paradigm for developing a decision process representation called the Colored Decision Process Petri Net (CDPPN). It extends the Colored Petri Net (CPN) theoretic approach including Markov decision processes. CPNs are used for process representation taking advantage of the formal semantic and the graphical display. A Markov decision process is utilized a...
متن کاملModeling Manufacturing Systems with Stochastic Petri Nets
This paper discusses models for manufacturing systems that are based on generalized stochastic Petri nets and on Markov decision processes. We employ generalized stochastic Petri nets to model manufacturing processes with high degree of uncertainty due to the human operator behavior. We extend the usual generalized stochastic Petri nets by allowing imprecision about probabilities to be explic...
متن کاملAsymptotic Throughput of Continuous Timed Petri Nets
We set up a connection between ContinuousTimed Petri Nets (the fluid version of usual Timed Petri Nets) and Markov decision processes. We characterize the subclass of Continuous Timed Petri Nets corresponding to undiscounted average cost structure. This subclass satisfies conservation laws and shows a linear growth: one obtains as mere application of existing results for Dynamic Programming the...
متن کاملAccessibility Evaluation in Biometric Hybrid Architecture for Protecting Social Networks Using Colored Petri Nets
In the last few decades, technological progress has been made important information systems that require high security, Use safe and efficient methods for protecting their privacy. It is a major challenge to Protecting vital data and the ability to threaten attackers. And this has made it important and necessary to be sensitive to the authentication and identify of individuals in confidential n...
متن کامل